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ALIGNMENT AND ORDERING OF VECTOR ELEMENTS FOR SINGLE 
INSTRUCTION MULTIPLE DATA PROCESSING 

FIELD OF THE INVENTION 

The present invention relates to the field of single instruction multiple 
data vector (SIMD) processing. More particularly, the present claimed 
invention relates to alignment and ordering vector elements for SIMD 
processing. 

BACKGROUND ART 

Today, most processors in microcomputer systems provide a 64 : bit 
wide datapath architecture. The 64-bit datapath allows operations such as 
read, write, add, subtract, and multiply on the entire 64 bits of data at once. 
However, for many applications the types of data involved simply do not 
require the full 64 bits. In media signal processing (MDMX) applications, for 
example, the light and sound values are usually represented in 8, 12, 16, or 24 
bit numbers. This is because people typically are not able to distinguish the 
levels of light and sound beyond the levels represented by these numbers of 
bits. Hence, data types in MDMX applications typically require less than the 
full 64 bits provided in the datapath in most computer systems. 

To efficiently utilize the entire datapath, the current generation of 
processors typically utilizes a single instruction multiple data (SIMD) method. 
According to this method, a multitude of smaller numbers are packed into 
the 64 bit doubleword as elements, each of which is then operated on 
independently and in parallel. Prior Art Figure 1 illustrates an exemplary 
single instruction multiple data (SIMD) method. Registers, vs and vt, in a 
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processor are of 64-bit width. Each register is packed with four 16-bit data 
elements fetched from memory: register vs contains vs[0], vs[l], vs[2], and 
vs[3] and register vt contains vt[0], vt[l], vt[2], and vt[3]. The registers in 
essence contain a vector of N elements. To add elements of matching index, 
5 an add instruction adds, independently, each of the element pairs of matching 
index from vs and vt. A third register, vd, of 64-bit width may be used to 
store the result. For example, vs[0] is added to vt[0] and its result is stored into 
vd[0]. Similarly, vd[l], vd[2], and vd[3] store the sum of vs and vd elements of 
corresponding indexes. Hence, a single add operation on the 64-bit vector 
10 results in 4 simultaneous additions on each of the 16-bit elements. On the 
_ other hand, if 8-bit elements were packed into the registers, one add operation 

y3 performs 8 independent additions in parallel. Consequently, when a SIMD 

CF1 arithmetic instruction such as addition, subtraction, or multiply, is performed 

j£ on the data in the 64-bit datapath, the operation actually performs multiple 

n] 15 numbers of operations independently and in parallel on each of the smaller 
m elements comprising the 64 bit datapath. In SIMD vector operation, 

£t processors typically require alignment to the data type size of 64-bit 

I: doubleword on a load. This alignment ensures that the SIMD vector 

~ operations occur on aligned boundaries of a 64-bit doubleword boundary. 

20 

Unfortunately, the elements within application data vectors are 
frequently not 64-bit doubleword aligned for SIMD operations. For example, 
data elements stored in a memory unit are loaded into registers in a chunk 
such as a 64-bit doubleword format. To operate on the individual elements, 
25 the elements are loaded into a register. The order of the elements in the 
register remain the same as the order in the original memory. Accordingly, 
the elements may not be properly aligned for a SIMD operation. 
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Traditionally, when elements are not aligned with a proper boundary 
as required for a SIMD vector operation, the non-aligned vector processing 
have typically been reduced to scalar processing. That is, operations took 
5 place one element at a time instead of simultaneous multiple operations. 
Consequently, SIMD vector operations lost parallelism and performance 
advantages when the vector elements were not properly aligned. 

Furthermore, many media applications require a specific ordering for 
10 the elements within a SIMD vector. Since elements necessary for SIMD 

processing are commonly stored in multiple 64-bit doublewords with other 
elements, these elements need to be selected and assembled into a vector of 
desired order. For example, multiple channel data are commonly stored in 
separate arrays or interleaved in a single array. Processing the data requires 
15 interleaving or deinterleaving the multiple channels. Other applications 
require SIMD vector operations on transposed 2 dimensional arrays of data. 
Yet other applications reverse the order of elements in an array as in FFTs, 
DCTs, and convolution algorithms. 

20 Thus, what is needed is a method for aligning and ordering elements 

for more efficient SIMD vector operations by providing computational 
parallelism. 
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SUMMARY OF THE INVENTION 

The present invention provides alignment and ordering of vector 
elements for SIMD processing. The present invention is implemented in a 
computer system including a processor having a plurality of registers. In the 
5 alignment of vector elements for SIMD processing, one vector is loaded from 
a memory unit into a first register and another vector is loaded from the 
memory unit into a second register. The first vector contains a first byte of an 
aligned vector to be generated. Then, a starting byte specifying the first byte of 
an aligned vector is determined. Next, a vector is extracted from the first 

10 register and the second register beginning from the first bit in the first byte of 
the first register continuing through the bits in the second register. Finally, 
the extracted vector is replicated into a third register such that the third 
register contains a plurality of elements aligned for SIMD processing. In the 
ordering of vector elements for SIMD processing, a first vector is loaded from 

15 a memory unit into a first register and a second vector is loaded from the 
memory unit into a second register. Then, a subset of elements is selected 
from the first register and the second register. The elements from the subset 
are then replicated into the elements in the third register in a particular order 
suitable for subsequent SIMD vector processing. 

20 
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BRIEF DESCRIPTION OF THE DRAWINGS 

The accompanying drawings, which are incorporated in and form a 
part of this specification, illustrate embodiments of the invention and, 
together with the description, serve to explain the principles of the invention: 

5 

Prior Art Figure 1 illustrates an exemplary single instruction multiple 
data (SIMD) instruction method. 

Figure 2 illustrates a block diagram of an exemplary computer system 
for implementing the present invention. 
10 Figure 3 illustrates a block diagram of an exemplary datapath for 

aligning and ordering vector elements. 

Figure 4 illustrates a block diagram of an alignment unit in a processor 
for aligning a vector of elements. 

Figure 5 illustrates a flow diagram of the steps involved in extracting 
15 an aligned vector from two exemplary vectors. 

Figure 6A illustrates a block diagram of a full byte-mode crossbar circuit 
used in generating a vector of elements from elements of two vector registers. 

Figure 6B shows a more detailed diagram of the operation of an 
exemplary AND gate associated with element 7 in the first register, vs. 
20 Figure 7 illustrates shuffle operations for ordering 8-bit elements in a 

64-bit doubleword. 

Figure 8A illustrates a block diagram of a shuffle operation, which 
converts four unsigned upper bytes (i.e., 8 bits) in a source register to four 16- 
bit halves in a destination register. 
25 Figure 8B illustrates a block diagram of a shuffle operation, which 

converts a vector of unsigned low 4 bytes from a source register to four 16-bit 
halves in a destination register. 
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Figure 8C illustrates a block diagram of a shuffle operation, which 
converts a vector of signed upper 4 bytes from a source register to four 16-bit 
halves in a destination register by replicating the signs across the upper bytes 
in the halves. 

5 Figure 8D illustrates a block diagram of a shuffle operation, which 

converts a vector of signed low 4 bytes from a source register to four 16-bit 
halves in a destination register by replicating the signs across the upper bytes 
in the halves. 

Figure 8E illustrates a block diagram of a shuffle operation, which 
10 replicates the odd elements of 8 8-bit elements from each of two source 
registers into 8 elements in a destination vector register. 

Figure 8F illustrates a block diagram of a shuffle operation, which 
replicates the even elements of 8 8-bit elements from each of two source 
registers into 8 elements in a destination vector register. 
15 Figure 8G illustrates a block diagram of a shuffle operation, which 

replicates the upper 4 elements of 8 8-bit elements from each of two source 
registers into 8 elements in a destination vector register. 

Figure 8H illustrates a block diagram of a shuffle operation, which 
replicates the lower 4 elements of 8 8-bit elements from each of two source 
20 registers into 8 elements in a destination vector register. 

Figure 9 illustrates shuffle operations for ordering 16-bit elements in a 
64-bit doubleword. 

Figure 10A illustrates a block diagram of a shuffle operation, which 
replicates the upper 2 elements of 4 16-bit elements from each of two source 
25 registers into 4 elements in a destination vector register. 
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Figure 10B illustrates a block diagram of a shuffle operation, which 

replicates the lower 2 elements of 4 16-bit elements from each of two source 

registers into 4 elements in a destination vector register. 

Figure IOC illustrates a block diagram of a shuffle operation, which 
5 replicates 2 odd elements of 4 16-bit elements from each of two source 

registers into 4 elements in a destination vector register. 

Figure 10D illustrates a block diagram of a shuffle operation, which 

replicates 2 even elements of 4 16-bit elements from each of two source 

registers into 4 elements in a destination vector register. 
10 Figure 10E illustrates a block diagram of a shuffle operation, which 

replicates even elements 0 and 2 from one source register into odd elements 1 

and 3 in a destination vector register and further replicates odd elements 1 

and 3 from another source register into the even elements 0 and 2, 

respectively, of the destination vector register. 
15 Figure 10F illustrates a block diagram of a shuffle operation, which 

replicates even elements 0 and 2 from one source register into odd elements 3 

and 1, respectively, in a destination vector register and further replicates odd 

elements 1 and 3 from another source register into the even elements 2 and 0, 

respectively, of the destination vector register. 
20 Figure 10G illustrates a block diagram of a shuffle operation, which 

replicates the upper 2 elements of 4 16-bit elements from each of two source 

registers into a destination vector register. 

Figure 10H illustrates a block diagram of a shuffle operation, which 

replicates the lower 2 elements of 4 16-bit elements from each of two source 
25 registers into a destination vector register. 
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DESCRIPTION OF THE PREFERRED EMBODIMENTS 

In the following detailed description of the present invention, 
numerous specific details are set forth in order to provide a thorough 
understanding of the present invention. However, it will be obvious to one 
5 skilled in the art that the present invention may be practiced without these 
specific details. In other instances well known methods, procedures, 
components, and circuits have not been described in detail so as not to 
unnecessarily obscure aspects of the present invention. 



10 The present invention, a method for providing alignment and 

ordering of vector elements for single-instruction multiple-data (SIMD) 
processing, is described. The preferred embodiment of the present invention 
provides elements aligned and ordered for an efficient SIMD vector operation 
in a processor having 64-bit wide datapath within an exemplary computer 

15 system described below. Although such a datapath is exemplified herein, the 
present invention can be readily adapted to suit other datapaths of varying 
widths. 

COMPUTER SYSTEM ENVIRONMENT 
20 Figure 2 illustrates an exemplary computer system 200 comprised of a 

system bus 206 for communicating information, a processor 202 coupled with 
the bus 206 for processing information and instructions, a computer readable 
volatile memory unit 210 (e.g., random access memory, static RAM, dynamic 
RAM, etc.) coupled with the bus 206 for storing information and instructions 
25 for the processor 202, a computer readable non-volatile memory unit 208 (e.g., 
read only memory, programmable ROM, flash memory, EPROM, EEPROM, 
etc.) coupled with the bus 206 for storing static information and instructions 
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for the processor 202. A vector register file 204 containing a plurality of 
registers is included in the processor 202. In the present invention, the term 
vector register file 204 encompasses any register file containing a plurality of 
registers and as such is not limited to vector register files. 

5 

The computer system 200 of Figure 2 further includes a mass storage 
computer readable data storage device 212 (hard drive, floppy, CD-ROM, 
optical drive, etc.) such as a magnetic or optical disk and disk drive coupled 
with the bus 206 for storing information and instructions. Optionally, the 

10 computer system 200 may include a display device 214 coupled to the bus 206 
for displaying information to the user, an alphanumeric input device 216 
including alphanumeric and function keys coupled to the bus 206 for 
communicating information and command selections to the processor 202, a 
cursor control device 218 coupled to the bus 206 for communicating user 

15 input information and command selections to the processor 202, and a signal 
generating device 220 coupled to the bus 206 for communicating command 
selections to the processor 202. 

According to an exemplary embodiment of the present invention, the 
20 processor 202 includes a SIMD vector unit that functions as a coprocessor for 
or as an extension of the processor 202. The SIMD vector unit performs 
various arithmetic and logical operations on each data element within a 
SIMD vector in parallel. The SIMD vector unit utilizes the register files of the 
processor 202 to hold SIMD vectors. The present invention may include one 
25 or more SIMD vector units to perform specialized operations such as 
arithmetic operations, logical operations, etc. 
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Figure 3 illustrates a block diagram of an exemplary datapath 300 for 
aligning and ordering vector elements. The datapath 300 includes a SIMD 
vector unit 302, an alignment unit 322, a register file 304, a crossbar circuit 314, 
and a vector load /store unit 302. The vector load/store unit 302 performs 
5 load and store functions. It loads a vector from memory into one of the 

registers in the register file 304. It also stores a vector from one of the registers 
in the register file 304 into main memory. The alignment unit 312 receives 
two vectors from two source registers such as vs 306 and vt 308. Then, the 
alignment unit 312 extracts an aligned vector from the two vectors and stores 

10 it into a destination register such as vd 310. The crossbar circuit 314 also 

receives two vectors two exemplary source registers, vs 306 and vt 308. The 
crossbar circuit 314 then selects a set of elements from the source registers and 
routes each of the elements in the selected set to a specified element in the 
exemplary destination register, vd 310. In an alternative embodiment, the 

15 crossbar circuit 314 may receive one vector from a single source register and 
select a set of elements from the vector. The data path 318 allows a result to 
be forwarded to the register file 304 or to the vector load /store unit to be 
stored into main memory. 

20 The SIMD vector unit 302 represents a generic SIMD vector processing 

unit, which may be an arithmetic unit, logical unit, integer unit, etc. The 
SIMD vector unit 302 may receive either one or two vectors from one or two 
source registers. It should be appreciated that the present invention may 
include more than one SIMD vector unit performing various functions. The 

25 SIMD vector unit 302 may execute an operation specified in the instruction 
on each element within a vector in parallel. 
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The exemplary vector register file 304 is preferably comprised of 32 64- 
bit general purpose registers. To this end, the preferred embodiment of the 
present invention utilizes the floating point registers (FGR) of a floating point 
unit (FPU) in the processor as its vector registers. In this shared arrangement, 
5 data is moved between the vector register file 304 and a memory unit through 
the vector load /store unit 302. These load and store operations are 
unformatted. That is, no format conversions are performed and therefore no 
floating-point exceptions can occur due to these operations. Similarly, data is 
moved between the vector register file 304 and the alignment unit 312, the 
10 crossbar circuit 314, or the SIMD vector unit 316 without format conversions, 
and thus no floating-point exception occurs. 



The present invention allows data types of 8-, 16-bit, 32-, or 64-bit fields. 
Hence, a 64-bit doubleword vector may contain 8 8-bit elements, 4 16-bit 



rj 15 elements, 2 32-bit elements, or 1 64-bit element. According to this 

q convention, vector registers of the present invention are interpreted in the 

2 following data formats: Quad Half (QH), Oct Byte (OB), Bi word (BW), and 

Long (L). In QH format, a vector register is interpreted as having 16-bit 
u elements. For example, a 64-bit vector register is interpreted as a vector of 4 

20 signed 16-bit integers. OB format interprets a vector register as being 

comprised of 8-bit elements. Hence, an exemplary 64-bit vector register is 
seen as a vector of 8 unsigned 8-bit integers. In BW format, a vector register is 
interpreted as having 2 32-bit elements. L format interprets a vector register 
as having a 64-bit element. These data types are provided to be adaptable to 
25 various register sizes of a processor. As described above, data format 

conversion is not necessary between these formats and floating-point format. 
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According to a preferred embodiment of the present invention, 
exemplary source registers, vs and vt, are each used to hold a set of vector 
elements. A third exemplary vector register, vd, is created from the source 
registers and holds a set of elements selected from the source registers. 
5 Although the registers, vs, vt, and vd, are used to associate vector registers 
with a set of vector elements, other vector registers are equally suitable for 
present invention. 

LOAD/STORE INSTRUCTIONS 
10 The load and store instructions of the present invention use a special 

load /store unit to load and store a 64-bit double word between a register in a 
register file such as an FPR and a memory unit. The doubleword is loaded 
through an exemplary load /store unit 302 illustrated above in Figure 3. The 
load/store unit performs loading or storing of a doubleword with upper 61 
15 bits of an effective address. The lowest 3 bits specify a byte address within the 
64-bit doubleword for alignment. 

According to a preferred embodiment, an effective address is formed by 
adding the contents of an index value in a general purpose register (GPR) to a 

20 base address in another GPR. The effective address is doubleword aligned. 
During the loading process, the last three bits of the effective address are 
ignored by treating these bits as 0s. Hence, the effective address is comprised 
of bits 3 to 63. The three bits from 0 to 2 contain the byte address for accessing 
individual bytes within a doubleword and are ignored by treating the three 

25 bits as 0s. If the size of a register in a register file is 64-bits, then the 64-bit data 
stored in memory at the effective address is fetched and loaded into the 
register. If on the other hand, the size of the register in the register file is 32- 
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bits, then the lower 32 bits of the data are loaded into the vector register and 
the upper 32 bits of the data are loaded into the next register in sequence. 
Hence, a pair of 32-bit registers are used to hold a 64-bit data from the 
memory. 



Conversely, the store instruction stores a doubleword from a vector 
register such as an FPR to the memory while ignoring alignment. The store 
operation is carried out through the exemplary load/store unit 302 illustrated 
above in Figure 3. The contents of a 64-bit doubleword in FPR, fs, is stored at 
10 the memory location specified by the effective address. The contents of GPR 
index and GPR base are added to form the effective address. The effective 
address is doubleword aligned. The last three bits of the effective address are 
ignored. 

15 The effective address is formed by adding the contents of an index 

value in a general purpose register (GPR) to a base address in another GPR 
while ignoring the lowest three bits of the effective address by interpreting 
them as 0s. That is, the effective address is comprised of bits 3 to 63. The 
ignored three bits contain the byte address for accessing individual bytes 

20 within a doubleword. If the size of a vector register is 64-bits, then the content 
of the vector register is stored into memory. If on the other hand, the size of a 
vector register is 32-bits, then the lower 32 bits of the data are concatenated 
with the upper 32 bits of the data contained in the next register in sequence. 
Then, the concatenated 64-bit doubleword is stored into memory at the 

25 address specified by the effective address. 
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ALIGNMENT INSTRUCTION 



The present alignment instruction operates on two 64-bit doublewords 
loaded into two registers from memory by issuing two load instructions. One 
doubleword is loaded into a first register (vs) and the other doubleword is 
5 loaded into a second register (vt). The alignment instruction generates a 64- 
bit doubleword vector in a third register (vd) aligned for a SIMD vector 
operation. Preferably, an alignment unit performs alignment of a vector by 
funnel shift to extract an aligned 64-bit vector of elements from the two 64-bit 
registers. 

10 

Figure 4 illustrates a block diagram of an alignment unit in a processor 
for aligning a vector of elements. The vector load/store unit 404 loads two 
vectors from main memory 402 into two vector registers, vs and vt, in a 
register file 408. The alignment unit 410 receives the two vectors in the 
15 vector registers, vs and vt, and extracts a byte aligned vector. Three control 
lines 412 representing three bits for the byte address controls the byte 
alignment performed through the alignment unit 410. The aligned vector is 
then forwarded to an exemplary vector register, vd, in the register file. 

20 The alignment of a vector is dependent on a byte ordering mode of a 

processor. Byte ordering within a larger data size such as a 64-bit doubleword 
may be configured in either big-endian or little-endian order. Endian order 
refers to the location of byte 0 within a multi-byte data. A processor according 
to the present invention may be configured as either a big-endian or little- 

25 endian system. For example, in a little-endian system, byte 0 is the least 

significant (i.e., rightmost) byte. On the other hand, in a big-endian system, 
byte 0 is the most significant (i.e., leftmost) byte. In the present invention, an 
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exemplary processor uses byte addressing for a doubleword access, which is 
aligned on a byte boundary divisible by eight (i.e., 0, 8, 16, 56). Hence, a 64- 
bit doubleword loaded into a register in a processor is byte-aligned in either a 
big-endian or a little-endian mode. For a little-endian mode processor, the 
5 starting (i.e., first) byte for a vector to be extracted lies in the second vector 
register. Conversely for a big-endian mode processor, the starting (i.e., first) 
byte for the vector resides in the first vector register. 

Figure 5 illustrates a flow diagram of the steps involved in extracting 
10 an aligned vector from two exemplary vectors. In step 502, two 64-bit 

doublewords are loaded from a memory unit into two 64-bit registers. One 
yj 64-bit doubleword is loaded into a first register and the other 64-bit 

rJl i 

|p doubleword in memory is loaded into the second register. Preferably, the 

fill 

in former doubleword and the next doubleword are stored in contiguous 

J 15 memory space and their starting addresses differ by 64-bits or 8 bytes. The 
jL. loading of the doublewords are accomplished through a load /store unit 

according to the load instruction described above. 

u The starting byte address of the aligned vector to be extracted is then 

20 determined in step 704. According to the preferred embodiment, the register 
and vector are all 64-bit wide. Since a 64-bit doubleword contains 8 bytes, 
three bits are needed to specify all the byte positions in a 64-bit doubleword. 
Hence, the preferred embodiment uses 3 bits to specify the position of the 
starting byte address in a 64-bit vector. 

25 

In one embodiment of the present invention, an alignment instruction 
provides an immediate, which is a constant byte address within a 
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doubleword. Preferably, the immediate consists of 3 bits for specifying a 
constant byte address to a byte among 8 bytes each in the first register (i.e., 
little-endian mode processor) and the second register (i.e., bit-endian mode 
processor). This alignment instruction performs a constant alignment of a 
5 vector. The align amount is computed by masking the immediate, then 
using that value to control a funnel shift of vector vs concatenated with 
vector vt. The operands can be in the QH, OB, or BW format. 

In an alternative embodiment, the alignment instruction provides a 
10 variable byte addressing by specifying an address of a general purpose register 
(GPR) containing the starting byte address in the first register. This 
instruction accesses the GPR by using the address provided in the alignment 
instruction. Then, the instruction extracts the lower 3 bits in the GPR to 
obtain the starting byte address in the first register (i.e., little-endian mode) or 
15 the second register (i.e., big-endian mode). The align amount is computed by 
masking the contents of GPR, rs, then using that value to control a funnel 
shift of vector vs concatenated with vector vt. The operands can be in QH, 
OB, or BW format. 

20 After determining the starting byte address in step 504 of the flowchart 

in Figure 5, the first bit of the starting byte address is determined in step 506 by 
multiplying the starting byte address by 8. For example, if the starting byte 
address were 3, the first bit of the starting byte address is 3*8 or 24. Then in 
step 508, a 64-bit doubleword is extracted by concatenating from the first bit at 

25 the starting byte address in one register continuing through the other register. 
This concatenation is accomplished by funnel shifting from the first bit of the 
starting byte. Specifically, the first register is assigned bit positions from 0 to 
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63. The second register is assigned the next 64 bit positions from 64 to 127. 
The extraction scheme depends on the byte ordering modes. A variable s, 
representing the first bit position at the starting byte address, can be used to 
simplify the illustration of the differences between the byte ordering modes. 
In a big-endian byte mode, the concatenation occurs from bit position 127-s to 
64-s. Conversely, in a little-endian bye mode, the concatenation occurs from 
bit position s through 63+s. 

Then in step 510, the extracted vector is replicated into a destination 
register in the register file for SIMD vector processing. In an alternative, 
embodiment, the extracted vector may be stored into the memory unit for 
later use. The process then terminates in step 512. 

SHUFFLE INSTRUCTION 
The shuffle instruction according to the present invention provides a 
vector of ordered elements selected from either one or two other vector 
registers. One or more load /store instructions are used to load the vector(s) 
into registers for shuffle operation. One embodiment uses a full byte-mode 
crossbar to generate a vector of elements selected from the elements of two 
other exemplary vectors. That is, selected elements of the exemplary vectors, 
vs and vt, are merged into a new exemplary vector, vd. The new vector, vd, 
contains elements aligned for SIMD operation. Alternatively, a plurality of 
shuffle operations may be carried out to arrange the elements in a desired 
order for SIMD vector processing. 

Figure 6A illustrates a block diagram of a full byte-mode crossbar circuit 
600 used in generating a vector of elements from elements of two registers. 



SGI-15-4-457.00 



October 7, 1997 




First, two vectors from a memory unit are loaded into two exemplary 
registers in a processor; the elements of the first vector are loaded into the 
first register, vs 602, and the elements of the second vector are loaded into the 
second register, vt 604. The elements of these two vector registers, vs 602 and 
5 vt 604, serve as source elements. The crossbar circuit 600 receives as input 
each of the elements from the two vector registers in parallel. A set of control 
lines 608 is coupled to the crossbar circuit 600 to relay a specific shuffle 
instruction operation. The shuffle instruction operation encodes a 
destination element for each of the selected source elements. In response to 
10 the specific shuffle instruction operation signals, the crossbar circuit 600 

selects a set of elements from the two registers, vs 602 and vt 604, and routes 
or replicates each element to its associated destination element in an 
exemplary destination register, vd 606. 

15 In addition, the present invention allows zeroing and sign extension 

of elements. For example with reference to Figure 6A, the present invention 
provides either zeroing or sign extension for each element in the first register, 
vs 602. In addition to providing the entire bits to the crossbar circuit 600, 
elements 0 through 7 in the first register, vs 602, provides their corresponding 

20 sign bits 612, 614, 616, 618, 620, 622, 624, and 626 (612 through 626) to the 
associated AND gates 628, 630, 632, 634, 636, 638, 640, and 642 (628 through 
642). Each of the AND gates 628 through 642 also receives as the other input, 
a control signal 610, which originate from a specific shuffle instruction for 
specifying either zeroing or sign extension mode. 

25 

Figure 6B shows a more detailed diagram of the operation of the 
exemplary AND gate 628 associated with element 7 in the first register, vs 602. 
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The AND gate 628 receives a single sign bit 612 from the most significant bit 
in the element 7 of the first register, vs 602. The AND gate 628 also receives 
the control signal 610. To provide zeroing for element 7 for example, the 
control signal 610 inputs a 0 into the AND gate 628. In this case, the output 
5 652 at the AND gate 628 is 0 no matter what the input is at the sign bit 612. On 
the other hand, when the control signal is 1, the AND gate 628 generates the 
sign bit 612 as the output 652, whatever the sign is. In both cases of zeroing 
and sign extension, the output 652 is routed to a plurality of output lines 654 
for replicating the output signal into an appropriate width. Preferably, the 
10 output lines 654 matches the number of bits in each element in the first 
register, vs 602. The crossbar circuit 600 accepts the signals on these output 
lines 652 and uses these signals to zero or sign extend element 7 when 
necessary according to a shuffle instruction. The AND gates for the other 



vectors of elements in a preferred OB or QH mode. In an OB mode, a 64-bit 
doubleword vector is interpreted as having 8 8-bit elements. In a QH mode, 

20 the 64-bit vector is treated as containing 4 16-bit elements. For example, in OB 
mode, the crossbar circuit 600 selects, in parallel, as source elements eight 8-bit 
elements among the elements in the registers vs 602 and vt 604. Each of the 
eight elements is then replicated or routed into a particular destination 
element in the destination vector register, vd 606. In QH mode, the crossbar 

25 circuit selects four 16-bit elements and replicates or routes each element into a 
particular destination element in the destination register. Those skilled in 
the art will appreciate that the crossbar circuit represents one embodiment of 



15 



elements 0 to 6 operate in a similar manner to provide zeroing and sign 
extension bit signals to the crossbar circuit 600. 



The preferred embodiment of the present invention operates on 



f 
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the present invention in implementing the shuffle instruction operations. A 
crossbar circuit is well known the art and is commonly used in conjunction 
with vector processing units. 

5 Figure 7 illustrates shuffle operations for ordering 8-bit elements in a 

64-bit doubleword. Each row represents the destination vector register, vd, 
comprised of 8 elements, vd[0] to vd[7]. The first row 702 is comprised of 
placeholders to indicate the 8 elements. Below the first row 702 are 8 different 
shuffle operations in OB mode as indicated by the content of destination 
10 vector register, vd, for each row 704 to 718. These shuffle operations in OB 
mode are illustrated in Figures 8A through 8H. 

Figure 8A illustrates a block diagram of a shuffle operation, which 
converts four unsigned upper bytes (i.e., 8 bits) in a source register to four 16- 

15 bit halves in a destination register. This shuffle operation, represented by 
mnemonic UPUH.OB, selects the upper 4 8-bit elements in an exemplary 
vector register, vs. The selected elements vs[4], vs[5], vs[6], and vs[7] are 
replicated into destination elements vd[0], vd[2], vd[4], and vd[6], respectively. 
The odd elements of the destination vector register vd[l], vd[3], vd[5], and 

20 vd[7] are zeroed. 

Figure 8B illustrates a block diagram of a shuffle operation, which 
converts a vector of unsigned low 4 bytes in a register to 16-bit halves. This 
shuffle operation, represented by mnemonic UPUL.OB, selects the lower 4 8- 
25 bit elements in an exemplary vector register, vs. The selected elements vs[0], 
vs[l], vs{2], and vs[3] are replicated into destination elements vd[0], vd[2], 
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vd[4], and vd[6], respectively. The odd elements of the destination vector 
register vd[l], vd[3], vd[5], and vd[7] are zeroed. 

Figure 8C illustrates a block diagram of a shuffle operation, which 
5 converts a vector of signed upper 4 bytes in a register to 16-bit halves. This 
shuffle operation, represented by mnemonic UPSH.OB, selects the upper 4 8- 
bit elements in an exemplary vector register, vs. The selected elements vs[4], 
vs[5], vs[6], and vs[7] are replicated into destination elements vd[0], vd[2], 
vd[4], and vd[6], respectively. The odd elements of the destination vector 
10 register vd[l], vd[3], vd[5], and vd[7] replicates the sign bits of the selected 
elements vs[4], vs[5], vs[6], and vs[7], respectively. 

Figure 8D illustrates a block diagram of a shuffle operation, which 
converts a vector of signed low 4 bytes in a register to 16-bit halves. This 

15 shuffle operation, represented by mnemonic UPSL.OB, selects the lower 4 8- 
bit elements in an exemplary vector register, vs. The selected elements vs[0], 
vs[l], vs[2], and vs[3] are replicated into destination elements vd[0], vd[2], 
vd[4], and vd[6], respectively. The odd elements of the destination vector 
register vd[l], vd[3], vd[5], and vd[7] replicates the sign bits of the selected 

20 elements vs[0], vs[l], vs[2], and vs[3], respectively. 

Figure 8E illustrates a block diagram of a shuffle operation, which 
replicates the odd elements of 8 8-bit elements from each of two source 
registers into 8 elements in a destination vector register. This shuffle 
25 operation, represented by an exemplary mnemonic PACH.OB, selects the odd 
elements of 8 8-bit elements in exemplary source vector registers, vs and vt. 
The elements selected from vs, namely vs[l], vs[3], vs[5], and vs[7] are 



SGI-15-4-457.00 



21 ^ October 7, 1997 




replicated into destination elements vd[4], vd[5], vd[6], and vd[7], respectively. 
The elements vt[l], vt[3], vt[5], and vt[7] from the vector register vt are 
replicated into destination elements vd[0], vd[l], vd[2], and vd[3], respectively. 

5 Figure 8F illustrates a block diagram of a shuffle operation, which 

replicates the even elements of 8 8-bit elements from each of two source 
registers into 8 elements in a destination vector register. This shuffle 
operation, represented by an exemplary mnemonic PACL.OB, selects the even 
elements of 8 8-bit elements in exemplary source vector registers, vs and vt. 
10 The elements selected from vs, namely vs[0], vs[2], vs[4], and vs[8] are 

replicated into destination elements vd[4], vd[5], vd[6], and vd[7], respectively. 

O 

The elements vt[0], vt[2], vt[4], and vt[6] from the vector register vt are 

Cn 

p replicated into destination elements vd[0], vd[l], vd[2], and vd[3], respectively. 

p. § 

SI 15 Figure 8G illustrates a block diagram of a shuffle operation, which 

jL replicates the upper 4 elements of 8 8-bit elements from each of two source 

j5 registers into 8 elements in a destination vector register. This shuffle 

yj operation, represented by an exemplary mnemonic MIXH.OB, selects the 

□ upper 4 elements of 8 8-bit elements in exemplary source vector registers, vs 

20 and vt. The elements selected from vs, namely vs[4], vs[5], vs[6], and vs[7] are 
replicated into the odd elements of the destination vector register, namely 
vd[l], vd[3], vd[5], and vd[7], respectively. The elements vt[4], vt[5], vt[6], and 
vt[7] from the vector register vt are replicated into the even elements of the 
destination elements vd[0], vd[2], vd[4], and vd[6], respectively. 

25 

Figure 8H illustrates a block diagram of a shuffle operation, which 
replicates the lower 4 elements of 8 8-bit elements from each of two source 
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registers into 8 elements in a destination vector register. This shuffle 
operation, represented by an exemplary mnemonic MIXL.OB, selects the 
lower 4 elements of 8 8-bit elements in exemplary source vector registers, vs 
and vt. The elements selected from vs, namely vs[0], vs[l], vs[2], and vs[3] are 
5 replicated into the odd elements of the destination vector register, namely 
vd[l], vd[3], vd[5], and vd[7], respectively. The elements vt[0], vt[l], vt[2], and 
vt[3] from the vector register vt are replicated into the even elements of the 
destination elements vd[0], vd[2], vd[4], and vd[6], respectively. 

10 A shuffle instruction operating in QH mode generates a new vector of 

elements for two types of operations. The first type of operation creates a 
vector of new data sizes by converting data sizes between 16-bit elements and 
32-bit elements in a vector. The second type creates a new vector of elements 
drawn from two other vectors. The present exemplary data type conversion 

15 operations enable a larger range of computational data format than their 

storage format, such as 32 bit computation on 16 bit numbers. In addition, the 
present embodiment operations allow conversion of a data set from a smaller 
range format to a larger range format or vice versa as between 16 and 32 bit 
data. 



Figure 9 illustrates shuffle operations for ordering 16-bit elements in a 
64-bit doubleword. Each row represents the destination vector register, vd, 
comprised of 4 elements, vd[0] to vd[7]. The first row 902 is comprised of 
placeholders to indicate the 4 elements. Below the first row 902 are 4 different 
25 shuffle operations in QH mode as indicated by the content of destination 
vector register, vd, for each row 904 to 918. These shuffle operations in QH 
mode are illustrated in Figures 10A through 10H. 
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Figure 10A illustrates a block diagram of a shuffle operation, which 
replicates the upper 2 elements of 4 16-bit elements from each of two source 
registers into 4 elements in a destination vector register. This shuffle 
5 operation, represented by an exemplary mnemonic MIXH.QH, selects the 
upper 2 elements of 4 16-bit elements in exemplary source vector registers, vs 
and vt The elements selected from vs, namely vs[2] and vs[3] are replicated 
into the odd elements of the destination vector register, namely vd[l] and 
vd[3], respectively. The elements vt[2] and vt[3] from the vector register vt are 
10 replicated into the even elements of the destination elements vd[0] and vd[2], 
respectively. 

Figure 10B illustrates a block diagram of a shuffle operation, which 
replicates the lower 2 elements of 4 16-bit elements from each of two source 

15 registers into 4 elements in a destination vector register. This shuffle 

operation, represented by an exemplary mnemonic MIXL.QH, selects the 
lower 2 elements of 4 16-bit elements in exemplary source vector registers, vs 
and vt. The elements selected from vs, namely vs[0] and vs[l] are replicated 
into the odd elements of the destination vector register, namely vd[l] and 

20 vd[3], respectively. The elements vt[0] and vt[l] from the vector register vt are 
replicated into the even elements of the destination elements vd[0] and vd[2], 
respectively. 

Figure IOC illustrates a block diagram of a shuffle operation, which 
25 replicates 2 odd elements of 4 16-bit elements from each of two source 
registers into 4 elements in a destination vector register. This shuffle 
operation, represented by an exemplary mnemonic PACH.QH, selects the 2 
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odd elements of 4 16-bit elements in exemplary source vector registers, vs and 
vt The elements selected from vs, namely vs[l] and vs[3] are replicated into 
the upper 2 elements of the destination vector register, namely vd[2] and 
vd[3], respectively. The elements vt[l] and vt[3] from the vector register vt are 
5 replicated into the lower 2 elements of the destination elements vd[0] and 
vd[l], respectively. 

Figure 10D illustrates a block diagram of a shuffle operation, which 
replicates 2 even elements of 4 16-bit elements from each of two source 
10 registers into 4 elements in a destination vector register. This shuffle 

operation, represented by an exemplary mnemonic PACL.QH, selects the 2 

Si 

even elements of 4 16-bit elements in exemplary source vector registers, vs 

Ci 

§3 and vt The elements selected from vs, namely vs[0] and vs[2] are replicated 

~ into the upper 2 elements of the destination vector register, namely vd[2] and 

■21 15 vd[3], respectively. The elements vt[0] and vt[2] from the vector register vt are 
!L replicated into the lower 2 elements of the destination elements vd[0] and 

vd[l], respectively. 

0 Figure 10E illustrates a block diagram of a shuffle operation, which 

20 replicates even elements from one source register and odd elements from 
another source register into a destination vector register. This shuffle 
operation, represented by an exemplary mnemonic BFLA.QH, selects the 2 
even elements of 4 16-bit elements from an exemplary source vector register, 
vs. The shuffle operation also selects the 2 odd elements of 4 16-bit elements 
25 from another exemplary source vector register, vt. The even elements 

selected from vs, namely vs[0] and vs[2] are replicated into the 2 odd elements 
of the destination vector register, namely vd[l] and vd[3], respectively. The 
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odd elements vt[l] and vt[3] from the vector register vt are replicated into the 
2 even elements of the destination elements vd[0] and vd[l], respectively. 

Figure 10F illustrates a block diagram of a shuffle operation, which 
5 replicates even elements from one source register and odd elements from 
another source register into a destination vector register. This shuffle 
operation, represented by an exemplary mnemonic BFLB.QH, selects the 2 
even elements of 4 16-bit elements from an exemplary source vector register, 
vs. The shuffle operation also selects the 2 odd elements of 4 16-bit elements 

10 from another exemplary source vector register, vt. The even elements 

selected from vs, namely vs[0] and vs[2] are replicated into the 2 odd elements 
of the destination vector register in reverse order, namely vd[3] and vd[l], 
respectively. The odd elements vt[l] and vt[3] from the vector register vt are 
replicated into the 2 even elements of the destination elements in reverse 

15 order, namely vd[0] and vd[l], respectively. 

Figure 10G illustrates a block diagram of a shuffle operation, which 
replicates the upper 2 elements of 4 16-bit elements from each of two source 
registers into a destination vector register. This shuffle operation, 

20 represented by an exemplary mnemonic REPA.QH, selects the upper 2 

elements of 4 16-bit elements in exemplary source vector registers, vs and vt. 
The upper elements selected from vs, namely vs [2] and vs[3] are replicated 
into the upper elements of the destination vector register, namely vd[2] and 
vd[3], respectively. The upper elements vt[2] and vt[3] from the vector register 

25 vt are replicated into the lower elements of the destination elements vd[0] 
andvd[2], respectively. 
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Figure 10H illustrates a block diagram of a shuffle operation, which 
replicates the lower 2 elements of 4 16-bit elements from each of two source 
registers into a destination vector register. This shuffle operation, 
represented by an exemplary mnemonic REPB.QH, selects the lower 2 
5 elements of 4 16-bit elements in exemplary source vector registers, vs and vt. 
The lower elements selected from vs, namely vs[0] and vs[l] are replicated 
into the upper elements of the destination vector register, namely vd[2] and 
vd[3], respectively. The lower elements vt[0] and vt[l] from the vector register 
vt are replicated into the lower elements of the destination elements vd[0] 
10 and vd[2], respectively. 

The shuffle instructions allow more efficient SIMD vector operations. 
First, the shuffle operation creates a vector of new data sizes by converting 
between 8-bit elements and 16-bit elements in a vector. These data type 
15 conversions enable a larger range of computational data format than their 
storage format, such as 16 bit computation on 8 bit numbers. For example, 
these operations allow conversion of a data set from a smaller range format 
to a larger range format or vice versa as between 8 and 16 bit audio or video 
data. 

20 

Second, the shuffle operations are also useful in interleaving and 
deinterleaving data. For example, some applications store multiple channel 
data in separate arrays, or interleaved in a single array. These applications 
typically require interleaving or deinterleaving the multiple channels. In 
25 these applications, separate R, G, B, A byte arrays may be converted into an 
interleaved RGBA array by the following series of shuffle instructions: 

MIXL.OB RGL, R, G ; RGRGRGRG 
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MIXL.OB BAL, B, A 
MIXH.OB RGH, R, G 
MIXH.OB BAH, B, A 
MIXL.QS RGBALL, RGL, BAL 
MIXH.QS RGBALH, RGL, BAL 
MIXL.QS RGBAHL, RGH, BAH 



BABABABA 
RGRGRGRG 
BABABABA 
RGBARGBA 
RGBARGBA 
RGBARGBA 



MIXH.QS RGBAHH, RGH, BAH; RGBARGBA 
Conversely, an interleaved RGBA array may be deinterleaved into separate R, 
G, B, and A arrays by the following series of shuffle instructions: 



* 15 



PACL.OB GA0GA1, RGBAO, RGBA1 

PACH.OB RB0RB1, RGBAO, RGBA1 

PACL.OB GA2GA3, RGBA2, RGBA3 

PACH.OB RB2RB3, RGBA2, RGBA3 

PACL.OB A0A1A2A3, GA0GA1, GA2GA3 

PACH.OB G0G1G2G3, GA0GA1, GA2GA3 

PACL.OB B0B1B2B3, RB0RB1, RB2RB3 

PACH.OB R0R1R2R3, RB0RB1, RB2RB3 



20 



u 25 



3^ 



35 



Third, some algorithms operate on 2 dimensional arrays of data such as 
images. Such an array typically orders the elements of the array in a major 
axis, where the elements are consecutive, and a minor axis, where the 
elements are separated by the size of the major axis. Often, a transpose 
operation is performed on the 2 dimensional array by converting the major 
axis to minor axis and vice versa. A common example is a discrete cosine 
transformation (DCT) requiring transposing 8x8 block of array. In this 
example, the 8x8 block of array consists of following elements: 





dO 


dl 


d2 


d3 


d4 


d5 


d6 


d7 


s0 


AO 


BO 


CO 


DO 


E0 


F0 


GO 


HO 


si 


Al 


Bl 


CI 


Dl 


El 


Fl 


Gl 


HI 


s2 


A2 


B2 


C2 


D2 


E2 


F2 


G2 


H2 


s3 


A3 


B3 


C3 


D3 


E3 


F3 


G3 


H3 


s4 


A4 


B4 


C4 


D4 


E4 


F4 


G4 


H4 


s5 


A5 


B5 


C5 


D5 


E5 


F5 


G5 


H5 


s6 


A6 


B6 


C6 


D6 


E6 


F6 


G6 


H6 


s7 


A7 


B7 


C7 


D7 


E7 


F7 


G7 


H7 
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The present invention can transpose the 8x8 transpose in OB mode in 
24 instructions, of which 12 are shown as follows: 



MIXH.OB tO, sO, si AO Al BO Bl CO CI DO Dl 

MIXH.OB tl, s2, s3 A2 A3 B2 B3 C2 C3 D2 D3 

MIXH.OB t2, s4, s5 A4 A5 B4 B5 C4 C5 D4 D5 

MIXH.OB t3, s6, s7 A6 A7 B6 B7 C6 C7 D6 D7 

MIXH.QH uO, tO, tl AO Al A2 A3 BO Bl B2 B3 

MIXH.QH ul, t2, t3 A4 A5 A6 A7 B4 B5 B6 B7 

MIXH.QH u2, tO, tl CO CI C2 C3 DO Dl D2 D3 

MIXH.QH u3, t2, t3 C4 C5 C6 C7 D4 D5 D6 D7 

REPA.QH dO, uO, ul AO Al A2 A3 A4 A5 A6 A7 

REPB.QH dl, uO, ul BO Bl B2 B3 B4 B5 B6 B7 

REPA.QH d2, u2, u3 CO CI C2 C3 C4 C5 C6 C7 

REPB.QH d3, u2, u3 DO Dl D2 D3 D4 D5 D6 D7 

MIXL.OB tO, sO, si EO El FO Fl GO Gl HO HI 

MIXL.OB tl, s2, s3 E2 E3 F2 F3 G2 G3 H2 H3 

MIXL.OB t2, s4, s5 E4 E5 F4 F5 G4 G5 H4 H5 

MIXL.OB t3, s6, s7 E6 E7 F6 F7 G6 G7 H6 H7 

MIXL.QH uO, tO, tl EO El E2 E3 FO Fl F2 F3 

MIXL.QH ul, t2, t3 E4 E5 E6 E7 F4 F5 F6 F7 

MIXL.QH u2, tO, tl GO Gl G2 G3 HO HI H2 H3 

MIXL.QH u3, t2, t3 G4 G5 G6 G7 H4 H5 H6 H7 

REPA.QH dO, uO, ul EO El E2 E3 E4 E5 E6 E7 

REPB.QH dl, uO, ul FO Fl F2 F3 F4 F5 F6 F7 

REPA.QH d2, u2, u3 GO Gl G2 G3 G4 G5 G6 G7 

REPB.QH d3, u2, u3 HO HI H2 H3 H4 H5 H6 H7 



In another example, an exemplary 4x4 array block consists of following 
elements: 





dO 


dl 


d2 


d3 


sO 


A 


B 


C 


D 


si 


E 


F 


G 


H 


s2 


I 


J 


K 


L 


s3 


M 


N 


O 


P 



A transpose operation of the 4x4 array block in QH mode uses 8 shuffle 
instructions as follows: 

MIXH.QH tO, so, si A E B F 

MIXH.QH tl, s2, s3 I M J N 
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REPA.QH dO, tO, tl 
REPB.QH dl, tO, tl 



AEIM 
BFJN 



5 



MIXL.QH tO, sO, si 
MIXL.QH tl, s2, s3 
REPA.QH d2, tO, tl 
REPB.QH d3, tO, tl 



CGDH 
KOLP 
CGKO 
DHLP 



The shuffle instructions such as BFLA and BFLB allow reversing the 
order of elements in an array, in pairs or groups of 4. Larger groups can be 

10 reordered by memory or register address because they are a multiple of 64 bit 
elements. Inverting the order of a large array can be accomplished by 
inverting each vector of 4 elements with BFLB and loading from or storing 
each doubleword to the mirrored address in the array. Similarly, a butterfly 
on a large array can be assembled from double word addressing and BFLA or 

15 BFLB operations on the addressed doublewords. 

The present invention thus provides a method for providing element 
alignment and ordering for SIMD processing. While the present invention 
has been described in particular embodiments, it should be appreciated that 
20 the present invention should not be construed as being limited by such 
embodiments, but rather construed according to the claims below. 
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